Papers with retrieval system
Sakura: Large-scale Incorrect Example Retrieval System for Learners of Japanese as a Second Language (P19-3)
Copied to clipboard
| Challenge: | Existing example retrieval systems do not include grammatically incorrect examples . existing systems only provide a small number of examples, hence, learners cannot acquire sufficient information when they search . |
| Approach: | They propose an incorrect example retrieval system called Sakura using a large-scale dataset for Japanese language learners. |
| Outcome: | The proposed system is more useful than previous systems. |
Automatically Suggesting Diverse Example Sentences for L2 Japanese Learners Using Pre-Trained Language Models (2024.acl-srw)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) are used to produce examples sentences targeting L2 learners. |
| Approach: | They propose to use pre-trained language models to produce diverse examples of Japanese sentences that are aligned with learners’ proficiency levels. |
| Outcome: | The proposed method is adaptable to other languages with minor adjustments. |
RAGAs: Automated Evaluation of Retrieval Augmented Generation (2024.eacl-demo)
Copied to clipboard
| Challenge: | RAGAs are a framework for reference-free evaluation of Retrieval Augmented Generation (RAG) pipelines. |
| Approach: | They propose a framework for reference-free evaluation of Retrieval Augmented Generation pipelines. |
| Outcome: | RAGAs can be used to evaluate RAG pipelines without human annotations . the framework can be useful for faster evaluation cycles given the fast adoption of LLMs based on human annotation. |
Learning to Retrieve Engaging Follow-Up Queries (2023.findings-eacl)
Copied to clipboard
Christopher Richardson, Sudipta Kar, Anjishnu Kumar, Anand Ramachandran, Zeynab Raeesy, Omar Khan, Abhinav Sethy
| Challenge: | Open domain conversational agents can answer a wide range of targeted queries, but knowledge exploration is a lengthy task. |
| Approach: | They propose a retrieval based system for predicting the next questions that the user might have . they train ranking models on a dataset called the Follow-up Query Bank . |
| Outcome: | The proposed system can proactively assist users in knowledge exploration leading to a more engaging dialog. |
Task-aware Retrieval with Instructions (2023.findings-acl)
Copied to clipboard
Akari Asai, Timo Schick, Patrick Lewis, Xilun Chen, Gautier Izacard, Sebastian Riedel, Hannaneh Hajishirzi, Wen-tau Yih
| Challenge: | Existing models that learn intents from labeled data are complicated and require a vast number of annotated examples to train a model. |
| Approach: | They propose a general-purpose task-aware retrieval system with instructions that can adapt to a new task without any parameter updates. |
| Outcome: | The proposed system outperforms two benchmarks on a set of domains and tasks on X2-Retrieval. |
Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing semi-parametric language models lack the capacity to perform zero-shot tasks . large language models have shown impressive zero-shoot ability, but huge model size costs . semi-parametric language model can be used to augment a smaller language model with retrieved background knowledge . |
| Approach: | They propose a semi-parametric language model for zero-shot task generalization that augments a smaller language model with retrieved related background knowledge. |
| Outcome: | The proposed model outperforms T0-3B by 16% across seven diverse evaluation tasks while being 3.8x smaller in scale. |
PromptReps: Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) excel in zero-shot document ranking tasks. |
| Approach: | They propose a prompt-based re-ranking method that requires no further training but is only feasible for reranking a handful of candidates due to computational costs. |
| Outcome: | The proposed method can retrieve documents from the entire corpus without training and with a large amount of paired text data. |
Argument Generation with Retrieval, Planning, and Realization (P19-1)
Copied to clipboard
| Challenge: | a novel argument generation framework is used to generate counter-arguments . CANDELA uses a text planning decoder to retrieve arguments of different perspectives . |
| Approach: | They propose a powerful retrieval system and a novel two-step argument generation framework . they use a retrieval-based retrieval platform indexed with 12 million articles from Wikipedia . |
| Outcome: | The proposed framework yields higher BLEU, ROUGE, and METEOR scores than state-of-the-art models. |
VizoMem: A Visual-Textual Memory Framework for Efficient Long-Horizon Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing systems that use long-context modeling incur computational and memory overhead. |
| Approach: | They propose a visual memory framework that pre-rendered text into structured images and stored as visual notes for agentic systems. |
| Outcome: | The proposed system reduces token consumption while preserving effective long-term memory recall. |
Multi-stage Training with Improved Negative Contrast for Neural Passage Retrieval (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing neural firststage retrieval models overcome lexical gap issue by projecting query and document to a shared dense space. |
| Approach: | They propose a multi-stage framework for neural passage retrieval using synthetic data, negative sampling, and fusion techniques. |
| Outcome: | The proposed framework improves retrieval accuracy and enhances the negative contrast in both stages. |
Improve Dense Passage Retrieval with Entailment Tuning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for dense retrieval have demonstrated remarkable performance in IR tasks. |
| Approach: | They propose a method to improve the embedding of dense retrievers by using existence claim as a bridge. |
| Outcome: | The proposed method can be plugged into current dense retrieval methods and the results are published in the journal Nature. |
MATCH: Modulating Attention via In-Context Retrieval for Long-Context Transformers (2026.acl-long)
Copied to clipboard
Linrui Ma, Chun Hei Lo, Xinyu Wang, Peng Lu, Xihao Yuan, Hanting Chen, Kai Han, Xinghao Chen, Chengjun Zhan, Hanlin xu, Yichun Yin, Lifeng Shang, Feng Wen, Boxing Chen, Yufei Cui
| Challenge: | Existing approaches to improve efficiency often enforce rigid structural constraints such as local attention windows. |
| Approach: | They propose a framework that augments sparse-attention mechanisms with dynamically integrated in-context information through an efficient retrieval system. |
| Outcome: | Empirical results show that MATCH significantly improves the performance of sparse-attention models on synthetic and real-world natural-language tasks. |
Context Filtering with Reward Modeling in Question Answering (2025.coling-main)
Copied to clipboard
| Challenge: | Question Answering (QA) tasks require a mix of relevant and irrelevant information in these contexts to perform well. |
| Approach: | They propose a context filtering approach that removes non-essential details, summarizing crucial content through Reward Modeling. |
| Outcome: | The proposed approach outperforms baseline models in 6.8-folds. |
Ambiguous Learning from Retrieval: Towards Zero-shot Semantic Parsing (2023.acl-long)
Copied to clipboard
Shan Wu, Chunlei Xin, Hongyu Lin, Xianpei Han, Cao Liu, Jiansong Chen, Fan Yang, Guanglu Wan, Le Sun
| Challenge: | Existing neural semantic parsers require a large amount of training data which is expensive and difficult to obtain. |
| Approach: | They propose a framework for a supervised retrieval system based on pretrained language models . they propose ambiguous supervision to improve the precision and coverage of the task . |
| Outcome: | The proposed approach outperforms state-of-the-art zero-shot parsing methods in ambiguous supervision. |
ConceptCarve: Dynamic Realization of Evidence (2025.acl-long)
Copied to clipboard
| Challenge: | ConceptCarve is a social media-based evidence retrieval framework that enables users to analyze complex thought patterns that manifest differently across social media communities. |
| Approach: | They propose ConceptCarve, an evidence retrieval framework that utilizes traditional retrieval systems and LLMs to dynamically characterize the search space during retrieval. |
| Outcome: | The proposed framework surpasses traditional retrieval systems in finding evidence within a social media community and produces an interpretable representation of the evidence for that community. |